REMARKS 

j 

This Preliminary Amendment cancels without prejudice claims 1-9 in the 
underlying PCT Application No. PCT/DE03/00700, and adds new claims 10-20. The new 
claims conform to U.S. Patent and Trademark Office rules and do not add new matter to the 
application. 

In accordance with 37 C.F.R. § 1.125(b), the Substitute Specification 
(including the Abstract, but without the claims) contains no new matter. The amendments 
reflected in the Substitute Specification (including Abstract) are to conform the 
Specification and Abstract to U.S. Patent and Trademark Office rules or to correct 
informalities. As required by 37 C.F.R. § 1.121(b)(3)(ii) and § 1.125(c), a Marked Up 
Version Of The Substitute Specification comparing the Specification of record and the 
Substitute Specification also accompanies this Preliminary Amendment. Approval and 
entry of the Substitute Specification (including Abstract) is respectfully requested. 

The underlying PCT Application No. PCT/DE03/00700 includes an 
International Search Report, dated July 25, 2003. The Search Report includes a list of 
documents that were uncovered in the underlying PCT Application. A copy of the Search 
Report accompanies this Preliminary Amendment. 

Applicant asserts that the subject matter of the present application is new, 
non-obvious, and useful. Prompt consideration and allowance of the application are 
respectfully requested. 
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METHOD FOR TRACKING AT LEAST ONE OBJECT IN A SCENE 

Background Information FIELD OF THE INVENTION 

The present invention is based on relates to a method for 
tracking at least one object in a scene according to the 
5 species of the independent patent claim . 

BACKGROUND INFORMATION 

Video sensors based on modern computer architectures are able 
10 to detect objects moving in a directional manner in image 
sequences of stationary cameras. The monitoring normally 
tracks the beginning point at which predefined threshold 
values with respect to segment distance or size are exceeded. 
Such condition is detected by changes in the image signal 
15 caused by the movement of objects such as persons, for 
example, whereupon a corresponding signaling or image 
recording takes place. In this manner, the objective of 
raising an alarm concerning an unauthorized entry may be 
realized . 

20 

Summary of the Invention SUMMARY 

The method according to the present invention for tracking at 
least one object in a scene-; — having the features of the 
25 independent p atent — claim, has the advantage that it generates 
a signaling as a function of the dwell time of an object at a 
particular location. In this way, an atypical behavior pattern 
in a monitored scene in which moving objects are usually 
present is detected immediately. This may result in a more 
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rapid alarm triggering, and thus in better monitoring. In the 
process, dwelling objects that have made the transition from 
movement to standstill are able to be detected and then result 
in a signal. 

5 

Advantageous improvements of the method for tracking at least 
one object in a scene, — which are indicated in the inde p endent 
claim, — are rendered possible by measures and further 
refinements specified in the dependent claims. 

10 

It is especially advantageous that in accordance with the 
present invention, the signaling, which is generated as a 
function of the a counter reading, results in an alarm. This 
means that an alarm is generated when an object remains 
15 stationary for a predefined period of time, the predef ineable 
predefined time constituting a threshold value for the counter 
reading . 

The movement of a particular object is described by a list or 

20 a matrix [[;]] j_ in one line, the image coordinates of the 

object in the x-direction are stored at different instants for 
the individual images of an image sequence and, in a second 
line, the corresponding y-values are stored, that is, the 
vertical values in of the obi ect scene at these corresponding 

25 instants. The x-value and the y-value at a predefined time 
instant represent a motion vector, i.e., in the movement 
direction of an object. If this motion vector is zero, a 
standstill is detected and the counter incremented. The list 
may be dynamically managed or, if a predefined number of list 

30 locations has been processed, it is possible that cumulative 
values are carried over into a new list for this object. This 
list representation makes it possible to monitor, and thereby 
track, several objects simultaneously. This is then managed 
with the aid of a processor of the video monitoring system and 

35 administered in the associated memory. A camera, which 
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generates the image sequence, acts as imaging element. The 
images are may be produced he ir e at relatively long intervals 
of half a second, for instance, so as to be able to detect the 
corresponding motions in a meaningful manner. Such motion 
5 vectors in a list may also be generated between images that do 
not follow each other immediately, for instance when the 
movements are very slow, which allows high resolution of the 
motion. This may be done dynamically, i.e., if no movement is 
detected, a counter may simultaneously be started while the 
10 comparison continues up to a certain number of image 

sequences, above which a standstill is then conclusively 
detected, and the counter reading ultimately becomes relevant. 

The list may then be newly initialized as soon as movement 
15 begins anew. If values for the object able to be detected by 
an various object -detect ion methods method are already 
available from a previous list, these may be carried over into 
the new list. This also makes it possible to analyze an entire 
movement sequence, which then represents a method is very 
20 efficient method with respect to the memory resources. 

Furthermore, it is advantageous that a reference image is 
generated so as to recognize an object in a simple manner. To 
generate a time and object template, a so-called reference 

25 image must be obtained that, if possible, contains only the 
background of the scene, without tracked objects. This 
reference image is generally obtained when no object is 
present, for example^ from the next -to- last image. This image 
may then be adopted as reference. This method is useful, in 

30 particular, for a small number of objects[[,]] which also make 
only a brief appearance in the scene. However, if many objects 
are tracked over longer periods of time, a reference image is 
generated in such a way that, after having determined the 
object positions in the instantaneous image, the reference 

3 5 image is carried over into the remaining area from the 
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next-to-last image. This is referred to as local adaptation of 
the reference image . 

The method according to the present invention -irs may be used 
5 in video monitoring, in particular, where at least one image 
generator, a processor, a memory and also output means^ ^re 
provided by which a signaling, such as an alarm, may then be 
implemented , are provided . However, the signaling may also be 
utilized as a signal for other systems. This video monitoring 
10 may be used to monitor a parking facility, in particular for 
example . 

Brief Description of — the Drawing 
BRIEF DESCRIPTION OF THE DRAWINGS 

15 

Exemplary embodiments of — the present — invention are — shown in 
the drawing and explained in greater detail — in the following 
description . — 

2 0 The figures show: 

Figure 1 i_s a block diagram of the video monitoring system 
according to the present invent ion [[;]] ^_ 

2 5 Figure 2 is a flow chart of the method according to the 

present invention [ [ ; ] ] A 

Figure 3 i_s a first example of video monitoring according to 
the present invention. [ [ ; ] ] 

30 

Figure 4 rs a second example of video monitoring-; — and 
according to the present invention. 

Figure 5 is a third example of video monitoring according to 

3 5 the present invention . 
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S p ecifi c ation DETAILED DESCRIPTION 



Video sensors based on modern computer architectures are able 
to dete c t — ob j ects moving — in a directional — manner — in — image 
5 se q uences — of — stationary cameras . — The monitoring normally 
tracks the beginning point at which pred e fin e d threshold 
values with respect — to segment distance or — size are exceed e d. 
3uch exceeding is detected by changes — in the image signal 
caused by the movement of ob j ects — such as persons, — for 
10 example , — whereupon a corresponding — si g naling or — image 

recording takes place . — In this manner, — the ob j ective of 
raising an alarm concerning an unauthorized entry is realized. 

According to the present invention, it is now possible to 
15 fully track objects across a scene , i.e., a monitored area . 
An object entering the scene is detected very quickly as a 
directionally moving object and monitored in the scene until 
the object leaves the scene again, such monitoring also being 
known as tracking. This is shown in Figure 3. At location 13, 
20 a person enters the scene monitored by an image generator 

detector , that is, a video sensor, for example, or some other 
camera, such as a heat image camera. Since the evaluation of 
the video monitoring detects movement only, the object is not 
yet detected in the first image sequence. Only at instant 14, 
25 after a movement had has been detected, was is this object 
identified. At instant 15, the constantly moving object has 
left the monitored scene. 

Figure 4 shows a second scenario. Here, too, a person enters 
30 the scene at instant 14 and is detected as a moving object at 
instant 14. However, the person stops moving at instant 16 and 
comes to a standstill, whereupon the method according to the 
present invention starts a counter in order to monitor the 
dwell time. A signaling will signal may then be generated as a 
35 function of the dwell time. This signaling may mean be an 
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alarm, for instance. 

Figure 5, in a third scenario, shows additional possibilities 
for a plurality of objects. An object 14 is detected as 
5 moving. At instant 17, a split is implemented here, that is, 
the object is split into two objects. This is detected by- 
different motion vectors originating from the same object. 
Instant 18 shows a so-called merge, i.e., a merging of two 
objects, which may then lead to another split. This merge is 
10 caused by an additional object 19, which was detected as 

moving object 20. The first object leaves the scene at instant 
21, while the second object makes the transition from movement 
to standstill at instant 22. 

15 Figure 1 shows a block diagram of a video monitoring system 
according to the present invention. An image provider 
detector , a monitoring camera 1 in this case, is connected to 
a processor 2 . A memory 3 is connected to processor 2 via a 
data input/ output. By means of a data line, processor 2 is 

20 connected to a control 4, which is connected to a loudspeaker 
5 on one side and to a display 6 on the other side. 

Only one camera 1 is indicated here by way of example. 
However, a plurality of cameras may be provided so as to 

25 monitor several scenes simultaneously and have these cameras 

operated by a processor 2. Furthermore, only one loudspeaker 5 
and one display 6, which are used to output an alarm, are 
illustrated here by way of example. However, the signaling 
transmitted from processor 2 to control 4 may be used as well. 

30 The method according to the present invention, which will now 
be elucidated on the basis of the flow chart shown in Figure 
2, runs may be executed on processor 2. In method step 7, on 
the basis of the motion vector and with the aid of camera 1 
and processor 2, a moving object is detected^ as shown in 

35 Figure 3. A list or matrix is prepared for this purpose^ in 
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which each column, for instance, denotes a specific image in 
an image sequence, with the image sequences being separated by- 
time intervals, such as one second, for example. Furthermore, 
the list has two lines defining the motion vector in a plane. 
5 This is normally defined by the coordinates x and y, for 
instance. Two lists illustrating this are shown in the 
following below . In list 1, a motion vector having x-value 
123 and y-value 12 is detected at instant 0. At instant 99, 
which corresponds to 50 seconds in this case, a standstill is 

10 counted that has already begun at instant 1, which corresponds 
to one second. This is a predefined list, that is, it allows 
only 100 new entries. For this reason, the list is newly 
initialized once instant 99 is reached^, and it is continued 
with the second list, which adopts the value. As shown, values 

15 123 and 12 are reentered at instant 0 and standstill 0/0 at 
instant 1. However, the 50 seconds are then added at instant 
2, and counting resumes anew. 

List 1: 



20 


Instant 


0 


1 


2 


3 


.... 99 




X 


123 


1 


2 


0 


.... 0 




Y 


12 


0 


3 


0 


.... 0 




0 :00 


0:01 


0:02 


0 : 03 




0:50 


25 


List 1, 


newly 


initialized : 






Instant 


0 


1 


2 


3 






X 


126 


0 


0 


0 






Y 


15 


0 


0 


0 





0:00 0:03 0:51 0:52 

30 

Using this list, the object is tracked in method step 8. If a 
standstill is detected in method step 9, namely by entries 0/0 
in the list, the counter is started in method step 10. If this 
is not the case, the object continues to be tracked by the 
35 list. However, if the counter was started in method step 10, 
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it is ascertained in method step 11 whether the a predefined 
threshold is reached-; — whi c h is predefined . Reaching this 
threshold causes a signaling in method step 12. In this case, 
the signaling may be implemented by means of loudspeaker 5 or 
display 6, that is, by outputting an alarm, for instance. 
However, if this threshold is not reached and the object moves 
again, it is returned to method step 8 and the tracking of the 
object resumes. 
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Abstract 



ABSTRACT 



A method is p roposed provided for monitoring at least one 
object in a scene, which method is distinguished in provides 
5 that, once a moving object stops moving and comes to a 

standstill, the dwell time at standstill is counted so as to 
generate a signaling as a function of the dwell time. The 
object is described by a list or a matrix concerning 
characteri zing the direction of movement and the time. 

10 

(Figure 1) 
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